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DETAILED ACTION 
Response to Arguments 

1. Applicants arguments, with respect to claims 1-18, 30, 36-38 and 40-44 filed 
7/7/2006 have been fully considered but they are not persuasive. Applicant argues, 
"Kuzma fails to teach or suggest a time stamp that specifies a specific time for delivery 
of such data structures 'relative to a specific start time.' In particular, the time stamp is 
merely described as a defining the time when the program or web page is to be 
broadcast. Kuzma does not define the time stamp as providing any specific time that is 
defined "relative to a specific start time, 'as claimed' In fact, and to the contrary, Kuzma 
notes that in scheduling programming, an 'absolute time' for content intervals is known, 
and that national network sources provide an 'absolute time reference' used by the local 
affiliates to coordinate local programming." The examiner respectfully disagrees. The 
only mention of an absolute time is in the BACKGROUND OF THE INVENTION, where 
the absolute time is in reference to the prior art (Col 1, Lines 26-33). The time 
stamp/timeline information is relative to the programming (Col 6, Lines 27-34). In 
response to applicant's argument that there is no suggestion to combine the references, 
the examiner recognizes that obviousness can only be established by combining or 
modifying the teachings of the prior art to produce the claimed invention where there is 
some teaching, suggestion, or motivation to do so found either in the references 
themselves or in the knowledge generally available to one of ordinary skill in the art. 
See In re Fine, 837 F.2d 1071, 5 USPQ2d 1596 (Fed. Cir. 1988)and In re Jones, 958 
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F.2d 347, 21 USPQ2d 1941 (Fed. Cir. 1992). The Office Action states the advantage of 
being able "...to synchronize the enhanced content with the video in real time". 

Applicant's arguments, with respect to claim 45 have been fully considered and 
are persuasive. Applicant argues that no ground of rejection were set forth for claim 45. 
Claim 45 is addressed below. 



Claim Rejections - 35 USC § 103 

2. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

3. Claims 1, 3, 5, 7-11, 14-18, 36-38 and 40-45 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over Carr (US Pat App Pub No 2003/0133043) in view of Kuzma 
(US Pat No 5,889,950) further in view of the ATVEF specification and further in view of 
Keronen et al. (US Pat No 6,567,530). 

In regard to claim 1, the Carr reference discloses a method and apparatus of 
communicating audio/video programs with enhancement data. The claimed step of 
obtaining a schema document, the schema document comprising a trigger data 
structure an announcement data structure, and a package data structure defining 
enhanced programming content is met by the content creator 12 providing 
enhancement data to transport operator 14 (Figure 1). The enhancement data provided 
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by the content creator 12 includes "an ATVEF announcement, a resource, and a trigger 11 
(Paragraph 0020, Lines 3-4). The enhancement data includes synchronization 
information (Paragraph 0013). The announcement data meets the limitation of a 
package data structure defining enhanced programming content. "An announcement 
may describe the location of both the resource stream and the trigger stream" (Para 
0021 , Lines 5-6). The claimed step for a timeline data structure regarding timing for the 
delivery of enhanced programming content is met by storage medium 1 1 3 and the 
controller 106 (Figure 2). The enhancement data is stored in storage medium 113 and 
is "accessed" by the controller 106. "The controller 106 may be run under control of a 
software routine 108 (referred to as a transport routine). The transport routine 108 may 
initially be stored in a storage medium 104 and loaded by the controller 106 for 
execution. Instructions and data of the transport routine 108 may also be stored in the 
storage medium 104" (Paragraph 0034, Lines 12-17). "The enhancement data and 
special announcements may be stored in a storage medium 113" (Paragraph 0034, 
Lines 23-25). The enhancement data stored includes an ATVEF announcement, which 
provides the instruction for delivery of the enhanced programming content. "The 
controller 106 detects presence of announcements when they appear at the ATVEF 
announcement address and port in the transport operator system 14. The 
announcements are separated out onto different IP addresses corresponding to the AA/ 
channels, with one IP address assigned for the one or more ATVEF announcements 
associated with each AA/ channel" (Paragraph 0038, Lines 12-19). The enhancement 
data is stored in storage medium 113 and is "accessed" by the controller 106, where the 
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enhancement data includes synchronization information. The examiner interprets 
synchronization information to be timeline data. The reference fails to explicitly disclose 
the claimed step of the timeline data structure specifying specific times relative to a 
specific start time and a particular order for delivering each of the trigger, 
announcement and package data structures to the receiver. The reference also fails to 
explicitly disclose the step analyzing the timeline data structure to determine when to 
deliver each of the trigger, announcement and package data structures. Kuzma 
teaches a schema document that is generic and non-specific to hardware that 
comprises a timeline data structure specifying specific times relative to a specific start 
time and a particular order for delivering each of the trigger, announcement and 
package data structures to the receiver and analyzing the timeline data structure to 
determine when to deliver each of the trigger, announcement and package data 
structures so as to synchronize the enhanced content with the video in real time 
(Figures 3-6, Co 2, Lines 38-54; Col 5, Line 63-Col 7, Lines 14). Consequently, it 
would have been obvious to one of ordinary skill in the art to implement Carr with a 
schema document that is generic and non-specific to hardware that comprises a 
timeline data structure specifying specific times relative to a specific start time and a 
particular order for delivering each of the trigger, announcement and package data 
structures to the receiver and analyzing the timeline data structure to determine when to 
deliver each of the trigger, announcement and package data structures for the stated 
advantage. The combination of Carr and Kuzma fails to explicitly disclose the timeline 
including a loop attribute to prevent multiple deliveries of the enhanced programming 
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content to the receiver. The ATVEF specification teaches a loop attribute to prevent 
multiple deliveries of the enhanced programming content to the receiver. The ATVEF 
specification discloses with respect to the parameter RetransmitExpiration: "This allow a 
resource to be carouseled, or sent repeatedly to increase the chances of delivery 
without missing segments. Set to zero if the resource will not be retransmitted" (Page 
22). Consequently, it would have been obvious to one of ordinary skill in the art to the 
combined teaching with a loop attribute to prevent multiple deliveries of the enhanced 
programming content to the receiver so as to conform to the ATVEF specification. The 
combination of Carr and Kuzma and the ATVEF specification fail to explicitly disclose 
the step of verifying the authenticity of the schema document by comparing the schema 
document against a stored standardized schema document. Keronen teaches verifying 
the authenticity of a document by comparing the document by comparing a document 
against a stored standardized document so as to ensure that a document is of proper 
form (Col 2, Lines 22-27). Consequently, it would have been obvious to one of ordinary 
skill in the art to implement the combined teaching with verifying the authenticity of a 
document by comparing the schema document by comparing a document against a 
stored standardized document so as to ensure that a document is of proper form. 

In regard to claim 3, the claimed step for accessing the schema document 
comprises the step of retrieving the schema document from a repository containing a 
plurality of schema documents is met by storage medium 113 and the controller 106 
(Figure 2 of Carr). The enhancement data is stored in storage medium 113 and is 
"accessed" by the controller 106. "The controller 106 may be run under control of a 
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software routine 108 (referred to as a transport routine). The transport routine 108 may 
initially be stored in a storage medium 104 and loaded by the controller 106 for 
execution. Instructions and data of the transport routine 108 may also be stored in the 
storage medium 104" (Paragraph 0034, Lines 12-17). "The enhancement data and 
special announcements may be stored in a storage medium 113" (Paragraph 0034, 
Lines 23-25). The enhancement data stored includes an ATVEF announcement, which 
provides the instruction for delivery of the enhanced programming content. "The 
controller 106 detects presence of announcements when they appear at the ATVEF 
announcement address and port in the transport operator system 14. The 
announcements are separated out onto different IP addresses corresponding to the AA/ 
channels, with one IP address assigned for the one or more ATVEF announcements 
associated with each AA/ channel" (Paragraph 0038, Lines 12-19). 

In regard to claim 5, the claimed limitation of the enhanced programming content 
comprising at least one of an announcement element, a trigger element, and a package 
element is met by the content creator 12 providing enhancement data to transport 
operator 14 (Figure 1 of Carr). The enhancement data provided by the content creator 
12 includes "an ATVEF announcement, a resource, and a trigger" (Paragraph 0020, 
Lines 3-4). The enhancement data includes synchronization information (Paragraph 
0013). The examiner interprets the resource to be the package element. 

In regard to claim 7, the claimed step of synchronizing the enhanced 
programming content with the television programming is met by "a trigger synchronizes 
the enhancement data with the TV transmission" (Paragraph 0021 of Carr). 
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In regard to claim 8, the reference discloses that the enhancement data is 
delivered with a communications protocol. "The three components may be transmitted 
using Internet Protocol (IP) multicast to the receivers" (Paragraph 0021 of Carr). 

In regard to claim 9, the Carr reference discloses two types of protocols which 
met the limitations for transport A protocol and transport B protocol. "The three 
components may be transmitted using Internet Protocol (IP) multicast to the receivers. 
An IP multicast standard is described in Request for Comment (RFC) 1301, entitled 
"Multicast Transport Protocol." RFCs may be available at website address 
[http://www.ietf.org/rfc.html]" (Paragraph 0020, Lines 4-8). And, the "ATVEF 
Specification may utilize a one-way transmission protocol (the Unidirectional Hypertext 
Transfer Protocol or UHTTP, described in the ATVEF Specification) to deliver resource 
data" (Paragraph 0021, Lines 9-12). 

In regard to claim 10, the Carr reference discloses a method and apparatus of 
communicating audio/video programs with enhancement data. The reference fails to 
explicitly disclose delivering the enhanced programming content before a deliver-by 
time. However, it is submitted that it would have been clearly obvious to one of ordinary 
skill in the art at the time of the invention to implement the Carr system with delivering 
the enhanced programming content before a deliver-by time so as to ensure that the 
receiver system receives the enhanced programming data necessary for an interactive 
viewing experience. 

In regard to claim 1 1, the Carr reference discloses a method and apparatus of 
communicating audio/video programs with enhancement data. The reference fails to 
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explicitly disclose delivering the enhanced programming content by a start time. 
However, it is submitted that it would have been clearly obvious to one of ordinary skill 
in the art at the time of the invention to implement the Carr system with delivering the 
enhanced programming content by a start time so as to allow the receiver system to be 
interactive. 

In regard to claim 14, the claimed step for delivering an announcement signal 
comprising the announcement data structure to the receiver, the announcement signal 
identifying tile availability of enhanced programming content to the receiver is met by 
the ATVEF announcement. "Generally, an ATVEF announcement indicates that 
enhancement data is being transmitted, a resource includes one or more files that 
contain the enhancement data" (Paragraph 0021, Lines 1-3 of Carr). The steps of 
delivering a package comprising the package data, delivering a trigger signal 
comprising the trigger data structure and in response to a selection by the viewer to 
receive the enhanced programming content, a step for displaying the enhanced 
programming content to the viewer is met by: "Generally, an ATVEF announcement 
indicates that enhancement data is being transmitted, a resource includes one or more 
files that contain the enhancement data, and a trigger synchronizes the enhancement 
data with the TV transmission. An announcement may describe the location of both the 
resource stream and the trigger stream. For each television (TV) channel, one or more 
enhancements may be offered as choices presented to the user, who can select which 
of the enhancements, if any, to view" (Paragraph 0021, Lines 1-9 of Carr). 
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In regard to claim 15, the "package" may include at least one file containing 
enhanced programming content. "Enhancement data may include graphics (e.g., web 
pages, multimedia information, or other digital data files), presentation layout" 
(Paragraph 0013, Lines 13-15 of Carr). 

In regard to claim 16, the "package" may include at least one link to enhanced 
programming content. "Enhancement data may include graphics (e.g., web pages, 
multimedia information, or other digital data files), presentation layout" (Paragraph 0013, 
Lines 13-15 of Carr). 

In regard to claim 17, the aforementioned combined teaching discloses a method 
and apparatus of communicating audio/video programs with enhancement data. The 
reference fails to explicitly disclose the trigger comprising a link to enhanced 
programming content. However, the examiner gives OFFICIAL NOTICE that it is 
notoriously well known that a trigger comprises a link to enhanced programming content 
so as to announce the availability of the interactive television experience to the user. 
Consequently, it would have been clearly obvious to one of ordinary skill in the art to 
implement the combined teaching with a trigger that comprises a link to enhanced 
programming content so as to announce the availability of the interactive television 
experience to the user. 

In regard to claim 18, the step of accepting a notification displayed to the viewer 
of the availability of enhanced programming content is disclosed. "For each television 
(TV) channel, one or more enhancements may be offered as choices presented to the 
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user, who can select which of the enhancements, if any, to view" (Paragraph 0021 , 
Lines 7-9 of Carr). 

In regard to claims 36-37, Carr discloses the communications line comprises a 
plurality of different channels. "To provide for greater flexibility and/or to alleviate 
bandwidth concerns of the transport medium 22, some embodiments of the invention 
transmit (using IP multicast) enhancement data associated with multiple AA/ channels 
(e.g., TV channels) over a link that is separate from the transport medium used to 
transmit AA/ content (or, alternatively, that is part of the same delivery mechanism as 
the A/V content but is not associated with any A/V channel, e.g., an MPEG-2 transport 
stream with ancillary information in a data-only program separate from the A/V 
programs)" (Paragraph 0025, Lines 1-10 of Carr). 

In regard to claim 38, the Carr reference discloses a method and apparatus of 
communicating audio/video programs with enhancement data. The Carr reference 
discloses that method may be implemented with a computer readable medium carrying 
computer-executable instruction. "The software or firmware can be loaded into the 
information delivery system in one of many different ways. For example, instructions or 
other code segments stored on one or more storage media or transported through a 
network interface card, modem, or other interface mechanism may be loaded into the 
system 10 and executed to perform programmed acts. In the loading or transport 
process, data signals that are embodied as carrier waves (transmitted over telephone 
lines, network lines, wireless links, cables and the like) may communicate the 
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instructions or code segments to the information delivery system" (Paragraph 0053 of 
Carr). 

In regard to claim 40, the aforementioned combined teaching discloses a method 
and apparatus of communicating audio/video programs with enhancement data. The 
combined teaching fails to explicitly disclose using a tag to validate the authenticity of 
the document. However, the examiner gives OFFICIAL NOTICE that it is notoriously 
well known to use tag for identification purposes so as to ensure correct receipt of 
information. Consequently, it would have been clearly obvious to one of ordinary skill in 
the art to implement the combined teaching with the use of tags for identification 
purposes so as to ensure correct receipt of information. 

In regard to claim 41 , the time stamp is a deliver by time for the enhancement 

data. 

In regard to claim 42, the time stamp indicated an order with respect to time for 
deliver. 

In regard to claim 43, the aforementioned combined teaching fails to explicitly 
disclose that the timeline data structure is zeroed at the beginning of the programming. 
However, it is submitted that it would have been clearly obvious to one of ordinary skill 
in the art torn implement the aforementioned combined teaching with a timeline data 
structure that is zeroed at the beginning of the programming so a to provide a time 
reference that is relative to the programming. 
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In regard to claim 44, video inherently has as specific number of frames per unit 
of time (e.g. 30 frames/second). By specifying time, a number of frames are also 
specified. 

In regard to claim 45, the aforementioned combined teaching fails to explicitly 
disclose providing enhancement content via email, separate from the a/v programming. 
However, the examiner gives OFFICIAL NOTICE that it is notoriously well known to 
provide enhancement content via email, separate from the a/v programming so as to 
allow the user to user their PC to perform tasks with the enhancement content that are 
not associated with the programming receiver, thereby increasing system functionality. 
Consequently, it would have been clearly obvious to one of ordinary skill in the art to 
implement the combined teaching with providing enhancement content via email, 
separate from the a/v programming for the stated advantage. 

4. Claims 2, 4, and 30 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Carr in view of Kuzma further in view of the ATVEF specification and further in 
view of Keronen et al. and further in view of Valdez Jr. (US Pat No 6,426,778). 

In regard to claim 2, the aforementioned combined teaching of claim 1 fails to 
explicitly disclose a step for viewing television programming deliverable to the receiver 
and in response to viewing the television programming, a step for creating the schema 
document associated with the television programming. The Valdez Jr. reference 
teaches viewing television programming deliverable to the receiver so as to facilitate the 
editing of the "compositions" or enhance content and in response to viewing the 
television programming creating the schema document associated with the television 
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programming so as to enhance the viewing pleasure of the television viewer. "Media 
playback 31 1 provides a facility for playing back compositions locally at the playback 
system or may transmit a composition as video transmission 321 and data transmission 
323" (Col 8, Lines 36-40). And, "to support editing of compositions of such a variety of 
media, a media editing system 309 is provided that may create data structures for 
organizing and storing information regarding a composition and perform operations for 
manipulating these data structures" (Col 8, Lines 22-26). Consequently, it would have 
been obvious to one of ordinary skill in the art to implement the combined teaching with 
viewing television programming deliverable to the receiver so as to facilitate the editing 
of the "compositions" or enhance content and in response to viewing the television 
programming creating the schema document associated with the television 
programming so as to enhance the viewing pleasure of the television viewer. 

In regard to claim 4, the combined teachings of Carr and Kuzma fails to explicitly 
disclose the step for creating the schema document comprises a step for creating the 
schema document with an authoring tool. The Valdez Jr. reference teaches a graphical 
user interface with an enhanced program editing system so to increase the ease of use 
for the operator. Consequently, it would have been obvious to one of ordinary skill in 
the art to implement the combined teaching with the step for creating the schema 
document comprises a step for creating the schema document with an authoring tool for 
the stated advantage. 

In regard to claim 30, the aforementioned combined teaching of claim 1 fails to 
explicitly disclose the use of XML. The Valdez Jr. reference teaches the use of XML so 
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as to represent a wide variety of document types. Consequently, it would have been 
obvious to one of ordinary skill in the art to implement the combined teaching with the 
use of XML for the stated advantage. 

5. Claims 6 and 12-13 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Carr in view of Kuzma further in view of the ATVEF specification and further in 
view of Keronen et al. and further in view of Goodman et al. (US Pat No 6,427,238). 

In regard to claim 6, the aforementioned combined teaching of claim 1 fails to 
explicitly disclose delivering the enhanced programming content in an order selected 
from the group consisting of a sequential order and an asynchronous order. This 
claimed step is interpreted by the examiner as being written in the alternative, such that 
the claimed limitation may be met by delivering the enhanced programming content in a 
"sequential order" or "an asynchronous order." The Goodman et al. reference teaches a 
timeline data structure that functions as the carousel data structure where the data 
modules are in sequential order (Figure 3) so as to provide a cyclic time-structured 
method of providing enhanced programming to the viewer. Consequently, it would have 
been obvious to one of ordinary skill in the art to implement the combined teaching with 
a timeline data structure that functions as the carousel data structure so as to provide a 
sequentially cyclic time-structured method of providing enhanced programming to the 
viewer. 

In regard to claim 12, the aforementioned combined teaching of claim 1 fails to 
explicitly disclose a timeline data structure that functions as the carousel data structure. 
The Goodman et al. reference teaches a timeline data structure that functions as the 
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carousel data structure so as to provide a cyclic time-structured method of providing 
enhanced programming to the viewer. Consequently, it would have been obvious to one 
of ordinary skill in the art to implement the combined teaching with a timeline data 
structure that functions as the carousel data structure so as to provide a cyclic time- 
structured method of providing enhanced programming to the viewer. 

In regard to claim 13, the aforementioned combined teaching of claim 1 fails to 
explicitly disclose a carousel data structure functions as the timeline data structure. The 
Goodman et al. reference teaches a carousel data structure that functions as the 
timeline data structure so as to provide a cyclic time-structured method of providing 
enhanced programming to the viewer. Consequently, it would have been obvious to one 
of ordinary skill in the art to implement the combined teaching with a timeline data 
structure that functions as the carousel data structure so as to provide a cyclic time- 
structured method of providing enhanced programming to the viewer. The trigger data 
structure, the announcement data structure, and the package data structure being 
delivered as fast as possible is implicit to the reference. Assuming arguendo with 
respect to the implicit teaching of the trigger data structure, the announcement data 
structure, and the package data structure being delivered as fast as possible, it is 
submitted that it would have been clearly obvious to one of ordinary skill in the art at the 
time of the invention to implement the combined teaching with transmitting 
enhancement data as fast as possible so as to advantageously provide the user with 
real-time interactive programming. 
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Conclusion 



6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to John Manning whose telephone number is 571-272- 
7352. The examiner can normally be reached on M-F: 9:00 - 5:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John W. Miller can be reached on 571-272-7353. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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